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ABSTRACT 

This paper introduces a reconstruction approach for the in- 
put signal of an oversampled filter bank (OFB) when the 
sub-bands generated at its output are quantized and transmit- 
ted over a noisy channel. This approach exploits the redun- 
dancy introduced by the OFB and the fact that the quantiza- 
tion noise is bounded. 

A maximum-likelihood estimate of the input signal is 
evaluated, which only considers the vectors of quantization 
indexes corresponding to subband signals that could have 
been generated by the OFB and that are compliant with the 
quantization errors. 

When considering an OFB with an oversampling ratio of 
3 /2 and a transmission of quantized subbands on an AWGN 
channel, compared to a classical decoder, the performance 
gains are up to 9 dB in terms of SNR for the reconstructed 
signal, and 3 dB in terms of channel SNR. 

1. INTRODUCTION 

In classical communication systems based on Shannon sep- 
aration principle HI, source coding and channel coding are 
optimized separately. However, due to delivery delay and 
processing complexity constraints, source and channel cod- 
ing have to be performed on short to moderate-size vectors of 
source samples. When the channel conditions are better than 
those for which the channel code has been designed, some re- 
dundancy added by the channel coder is wasted. When they 
are worse than expected, transmission errors may not be ef- 
ficiently corrected, and will have a detrimental effect on the 
reconstructed bitstream, see J2) . 

Joint source and channel coding (JSCC) techniques have 
been considered to address these issues (3). In this context, 
oversampled filter banks (OFB) J4]|5j are particularly inter- 
esting, since they perform a signal decomposition into sub- 
bands, leaving some controlled redundancy among subbands. 
When transmitted over a communication channel, subbands 
are usually first quantized, introducing some background 
quantization noise in the transmitted subbands. Quantiza- 
tion indexes are then packetized and transmitted over a noisy 
channel. In absence of residual transmission errors, the re- 
dundancy introduced by the OFB in the subband domain has 
been shown to be helpful to combat quantization noise [6|. 

When channel impairments are badly corrected by chan- 
nel decoders at receiver side, corrupted packets are obtained. 
Classical error detection techniques, such as CRCs or check- 
sums, check the integrity of these packets Q. When an er- 
roneous packet is detected, retransmission may be asked, but 
in delay-constrained applications, this is not always possi- 
ble. The content of the packet is then lost. The robustness of 



OFB and more generally of frame expansions to the erasure 
of a whole subband has been evidenced, e.g., in ll8l l9l HOl . 
The design freedom offered by OFB thanks to the introduced 
redundancy allows to construct synthesis filter banks that ex- 
ploit the available samples at the receiver side to reconstruct 
the original signal with a minimal quadratic reconstruction 
error. These results have been extended in 1 1 1 1 to the case 
of several subbands randomly affected by erasures, as is the 
case when quantized subbands are interleaved before being 
packetized. A progressive missing subband estimation tech- 
nique has been developed in that case. 

When corrupted packets are not dropped, transmis- 
sion errors result in corrupted quantization indexes, lead- 
ing to subband samples corrupted by (large-variance) im- 
pulse noise. Samples not affected by transmission errors 
are also corrupted by (moderate-variance) quantization noise 
introduced at the transmitter side. A Gaussian-Bernoulli- 
Gaussian noise model |[T2l representing quite accurately the 
effect of quantization noise and transmission impairments 
has been used in fPH . Parity-check filter banks associated 
to the analysis OFB have been exploited to build hypotheses 
tests determining whether a subband is affected by a trans- 
mission impairment at some time instant. These tests rely 
on computing a threshold whose value depends on the ratio 
of the variance of the impulse noise to that of the quanti- 
zation noise (Impulse over quantization noise ratio, IQNR). 
The samples detected as corrupted are then corrected with a 
Bayesian estimator. An alternative approach to detect and 
correct corrupted subband samples has been proposed in 
03] Q3] using Kalman filtering techniques. This method re- 
lies as well on a set of parameters to be chosen in advance 
(noise covariance matrices). 

The performance of all previously mentioned techniques 
is strongly dependent of the characteristics of the noise 
model. In practice, the quantization noise is not Gaussian, 
but more or less uniformly distributed, and the IQNR is not 
that high, leading to situations where the error detection and 
correction is difficult. 

The aim of this paper is to exploit the redundancy in- 
troduced by the OFB and to explicitly take into account the 
channel noise model and the bounded quantization noise. A 
suboptimal maximum-likelihood (ML) estimator is derived. 
The estimation is performed in the subspace of all consistent 
indexes, i.e., indexes that can result from the quantization of 
a subband signal belonging to the subspace of subbands that 
may be generated at the output of the considered OFB. 

An implementation with a reasonable complexity of the 
proposed ML estimator is proposed. The main idea is to per- 
form at each time instant an estimation of the vector of the 
most likely indexes with a sequential algorithm such as the 



M-algoriihm lfl6l and then eliminate those not deemed as 
consistent. The consistency test is operated using interval 
analysis IfTTl , but it could alternatively be done via the solu- 
tion of several linear programs. 

The rest of the paper is organized as follows. Section [2] 
describes the considered transmission scheme based on an 
OFB. The formulation of the optimal ML estimator of the 
source samples from channel outputs is given in Section [3] 
A suboptimal estimator is presented in Section|4]and the cor- 
responding estimation algorithm is given in Section [5] Pre- 
liminary simulation results are shown in Section [6] before 
providing some conclusions. 



(tmi, ■ ■ ■ > r Af,+M-i) of binary-, real- , or complex-valued 
samples is finally obtained at channel output. 

A classical decoder would perform a hard decision on r 1 
to get some estimate u' of u ! . After inverse quantization of 
u', the received subbands y' are obtained. Finally, the recon- 
struction is performed using the pseudo-inverse of the E(z), 
whose polyphase representation/?^) = (E (z) T E (z))~ l E (z) T 
is a N x M matrix such that R(z)E(z) = Inxn, where Inxn is 
the N x N identity matrix. Nevertheless, this estimator may 
produce estimated subbands y' which may not be produced 
by the considered OFB. The proposed estimator addresses 
this issue. 



2. CODING AND TRANSMISSION SCHEME 

Figure[T]describes a typical transmission scheme based on an 
M— band OFB with a downsampling factor of N < M, intro- 
ducing a redundancy in the subbands of M/N. The analysis 

filterbank consists of M FIR analysis filters {h m } m Z with 
maximal length N x (L+l). The corresponding polyphase 
representation of these filters isaMxiV matrix E(z). At each 
instant i, the vector x' = (xw, . . . jJCm+n-i) 7 " is placed at the 
input of the OFB and the vector y' = (yMi, ■ ■ ■ ,ytii+M-i) is 
obtained at its output. The relation in the temporal domain 
between the input and the output of the OFB is then 

y' = £E / x i -' = E L :ox i - u , (1) 

1=0 

where x ,_L: ' = ^(x'~ L ) r , . . . , (x') 7 ^ contains all input 

samples affecting the OFB output at time ; and E^ o = 
(Ez,, . . . , Eo) is a M x (L+l)N matrix formed by a sequence 
of M x N matrices E/, I =Q,...,L that can be constructed 
from {h m }^TQ |fl8l . Since E (z) represents a FIR filter bank, 
one can find a (M — N)xM polyphase matrix P (z) such that 
P (z) E (z) = Vz <E C and that represents a FIR parity-check 
filter bank, see Proposition 1 in |[l"3l . One can then write 

d 

P(z) = £P,z-'. (2) 

1=0 

Since P (z) E (z) = 0, one has 
d 

£P,y'-'=P L , y'- L ' :i = 0, (3) 

/=o 



where y ! 




. This property al- 



lows to determine whether a subband signal may be obtained 
at the output of an OFB. 

For the transmission, each component yMi+m, m = 
0, . . . ,M— 1, of the vector y' is quantized using a scalar quan- 
tizer with a step-size A m . The resulting quantization indexes 
UMi+m are binarized to get a sequence h Mi+m = b(w M , +m ) 
of R m bits. The whole vector u' = (uui, ■ ■ ■ ,UMi+M-i) 
of quantized indexes is then represented by a binary se- 
quence h) 1 = (b^,-,...,b^ i+M _ 1 ) of Y^mZoRm bits that are 
BPSK modulated and then transmitted over a memoryless 
channel with a transition probability g(r\b). A vector r' = 



3. OPTIMAL ML ESTIMATOR 

At receiver side the ML estimate of the input vector at time 
; assuming that all channel outputs have been gathered in a 
vector r is 

x' = arg max p(r\x!), (4) 
X'e[x] 

where [x] is a vector of intervals (or box) to which all the 
vectors x' are known to belong. The box [x] may be ob- 
tained from the dynamic of the input signal. It is aussmed 
to be known a priori by the receiver. Since the channel is 
memoryless and the maximal length of the impulse response 
of the analysis filters is N x (L+l) one gets 

x' = arg max p(r''- ,+L \x') (5) 
x'e[x] 

where r ,:,+L = ((r') 7 , . . . , (r' +L ) T ) . Let be the set of 

all vectors u' of indexes that may be obtained at the output 
of the quantizers. This set, containing at most 11^=0 ^ m ^~ 
ements, is independent of i since the characteristics of the 
scalar quantizers do not depend on time. Then, the condi- 
tional probability in (0 becomes 

p(r ti+L \Z) = £ p(r , ■ ^+L ,a'' :, ' +L |x , '), 

E p(r ti+L \u i:i+L ^ i )p(u i:i+L \3i i ) 

(6) 

The channel output r'-' +L depends only on the channel input 
u E,+L . Hence, x' does not provide any additional knowledge 
on r l:l+L once u v,+L is known, i.e., x' < — > ^ L '-'+ L < — s, f i.i+l 
forms a Markov chain. Then © becomes 

p (r i:,+L |x'') = £ p (r i:i+L \u u+L ) p (u"^ 1 ) (7) 

Using the fact that the channel is memoryless, the first term 
p (r' n+ |u !:!+i ) of ^ is easily obtained from the channel 
transition probability 

L 

p(r i:i+L \u ti+L ) =Y[p(r i+e \u i+i ) 

t=0 
L M-l 

= PI P( V M(i+e)+m\uM{i+e)+m), 

e=o m=0 

L M-l 

= O O 8{ r M(i+t)+m\H u M(i+()+m))- 
(=0 m=0 

(8) 
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Figure 1 : Transmission scheme based on an M-band oversampled filter bank 



The term g{Y M[i+l)+m \h{u M[i+e)+m )) of ® is then obtained 
as the product of R m channel transition probabilities corre- 
sponding to the R„, bits in b(u M ^ i+ ^ +m ). 

The second term p (u' :,+L |x') of (|7]i is much more com- 
plex to evaluate. Moreover, the number of terms of the sum 
in (0 is in general prohibitively large. A suboptimal estima- 
tor is thus introduced in the next section. 

4. SUBOPTIMAL ML ESTIMATOR 

A suboptimal ML estimator for x ! is obtained when consid- 
ering only the channel output at time i. Thus, one gets 



and 



x' = arg max p(r ! |x ! ) 

S'efx] 



p(r i \Z i ) = £ p(r<|S0p(5'|x<) 

u'e"?/ 



(9) 



(10) 



To evaluate p (u'|x ! ), one knows that a vector of quan- 
tized indexes u' is produced when the value y' taken by 
the random vector Y' of OFB outputs belongs to some 
box [y< (5<)] = [y 1 ' (S<) -^,y i (u<) + f ], where y* (tf) 
is obtained from inverse quantization of u' and A = 



(Ai 



,A M ) ■ Then 



p (r'|X ; = xO = £ p (r'|S<) p (Y< e [y< (u')] |X' = x') , 

(11) 

where X 1 is the random vector at the input of the analysis 
OFB. One may show that the second term of (fTTT) may be 
written as 

/.(Y'efy'-^OllxO 

p (V 6 [y'' (5')] ,x'" L:! '- 1 |x ! ') rfX''-^'" 1 



where/ (u'',x''- L: '') = p (E L:0 X , '- L: '' 6 [y'' (u 1 )] |x'- L: '). For 
a specific value u' one has 



i ~i—L:i\ 



1 ifE L: ox''- L: ''G [y'(5')] 
otherwise. 



The term / (u ! ,x ! : M accounts for the fact that all values in 
& cannot be obtained at the quantized output of the OFB. 
One then obtains 



x' = arg max £ p(r'\u') J p[x' 



d-L:i-l 



X ! ) dx' 



-L:i-l 



(12) 



where 



[u\Sc') = [it-™- 1 G [x] L |E L:0 x'-- i: '- e [y 1 ' (3*)] } 



Assume further that the estimation process in the previ- 
ous instants j = i—L,...,i—l has been able to provide boxes 
[x- 7 ] such that x 7 G [x 7 ] . Then, ( TTZb becomes 



A 1 ' = arg max £ p (r*|tf) / /> (5c* — Xs * — 1 15^) rfSP 



(13) 



Consider now for each u' G ^ the set 



(u ( ) = |x ! ' g [x]| [x 1 -™- 1 ] r\y (n ! ',x') / 0} 



G X 



i-L.i-ll 



= {X'G[x]|3X' 

such that E x'' £ [y'' (u 1 ')] - El : iX , '~' L:, '~ 1 } 

This set contains all values of the input vector at time i 
for which there exists some value of the preceding input 
vectors that leads to quantized OFB output indexes repre- 
sented by u'. 3t~ l (u 1 ) is either empty or is a polytope 1191 . 
p(E £ . X'~ L:i G [y'(u')] \%~ L:i )p(x i ~ L:i ~ 1 \£)dx!~ L:i ~ 1 The set <% can be then partitioned into two subsets % = 

{u* G ^ 1 3t"' (u') = 0} and % = {u'' G ^|iT' (u') / 0}. 
Therefore ( fT3T > becomes 

Then, © becomes „ 

x' ^arg max £ p(r ! '|ff) / p(x i - u - 1 \x i )dx i - Ld - 1 . 
^ = arg max £ p (r^tf) // (tf ,5?"*') p (x^- 1 |x') dx'"^ 1 *' €[xl S'e* [^-i]^^) 



'u'Gf/ 



(14) 



4.1 Other approximations 

In (TBI , instead of considering all terms of the sum over all 
u' € , we only consider the term corresponding to 



arg max p Ir u 



(15) 



This is the ML estimate of the quantized indexes at time i ac- 
counting for the fact that u' S %\, i.e., that it can be obtained 
as a quantized output of the considered OFB. The classical 
ML estimate would consider a maximization over °i/ in <TT3T >. 
Using dT3T >, <TT~4-b becomes then 



x = arg max 

x'Gfx] 



x') dx' 



-L:i-\ 



(16) 



where the integral in ( TToT l vanishes when x' 4 (u ! ). 

Evaluating the function to maximize in ( fToT ) is still com- 
plicated. Thus, one evaluates the set of values S£ l (u 1 ) on 
which the interval does not vanish, or more precisely an 
outer-approximation of this set. Considering some u' G , 
an outer approximation [x 1 (u 1 )] of (uM may be evalu- 
ated in several ways. One may consider solving several linear 
programming problems, or using tools from interval analysis 
IfTTl . If an empty outer-approximation is obtained for some 
u', then u' ^ This allows to construct an iterative algo- 
rithm that evaluates at each i the most likely vectors of in- 
dexes and keeps only the most likely one which also belongs 
to ^i. 

4.2 Parity-check test (PCT) 

To determine whether some vector of indexes belongs to , 
one may alternatively use the parity-check polyphase matrix 
P(z). One knows that if y'~ L : ' contains only vectors cor- 
responding to the output of the OFB with polyphase matrix 
E(z), then (0 is necessarily satisfied. Consider now a box 



r i-L':i 



IfOgP L ':0 



i-L':i 



y 

i-L'.i 



, then, there cannot be any se- 



such that y' L : ' is the 



J-V:i 



quence of L' vectors y 

output of the OFB with polyphase matrix E (z). This allows 
to build a quick test to determine whether [y' (u ! )l may con- 
tain an OFB output at time i and consequently whether u' has 
to be further considered. For that purpose, a box y'~ L 1-1 

containing previously verified outputs has to be available. 
Then, for some u ! , if 



i=i 



-j-l 



-Po[y ! '(5'')] 



(17) 



then u' does not belong to . 

The proposed algorithm is described in Section|5] 

5. ESTIMATION ALGORITHM 

This section describes the OFB input signal estimation algo- 
rithm using the signal measured at channel output. 



1. Input: [x'- u - 1 ], y'-^'- 1 

2. Initilization: k = 1 ; I 



1 . 

1 ' -^cand 



Output: [x 1 ], [y 1 ]. 
0. 



Sort the vectors of indexes u' in the decreasing likelihood 
p (r'|u'). Keep the N max most likely candidates S£ can <i = 

{5<(l),...,5<(AWx)}. 
Do 

(a) Evaluate [x'(u'(£))] C [x] satisfying 
E [x< (S ! ' (*))] C [y< (tf (*))] - E L:1 [x^ 1 ] . 

(b) If [x<(S<>))] ^0 then if^r 

(c) k = k+l; 
while k < Nmnx ; 



If S£^ nd = then [x 1 ] = [x'' (u ! ' (1))] ; u ! = u'' (1); Indi- 
cate an error. End. 



Else JVmax = 



"°cund 



7. Do 

8. Apply the parity-check test on 
(a) If e L^P/fy 1 '-'] +1 



9% 



X' = 



x 







y = 



cand (0 



r \se. 

y'(^ 
y 



(Hid 



(i) 



then 



^(0 



u 

(b) Else l = H 
while I < N^L 



^(0;End. 



10. 



x' 



x ! ( jy 

x \^z c 



cand ( ^ ) 



. [y'l 



y ( '(^(i) 



-S? c w (1), Indicate an error. End. 



In the first call of the algorithm (; =1), the vectors 
[x 7 ] , j = i — L, . . . , i — 1 and [y 7 ] , j = i— L 1 , . . . ,i — 1 are ini- 
tialized to [0,0]. 

Step 3. can be performed with an M-algorithm ifTBI . 

Step 4a. may be performed using linear programming 
or interval analysis IfTTl . In the latter case, the problem is 
to enclose the n— dimensional polytope X 1 (u 1 ) by an n— 
dimensional box [x ! (u' )]. The box [x''(u ! ')] is an outer ap- 
proximation of 3t~ l (u'). 

At step 6., ^ c 1 1 j contains the most likely vectors of in- 
dexes u ! for which one was not able to prove that they are not 
in . The PCT is then applied to eliminate some candidates 
in -Sf^ 1 

The most likely vector of indices u ! £ a i/\ is then ob- 
tained in the output of the algorithm as well as [x' (u' )] and 
a box [y ! ] = [y' (u ! )l containing the noise-free OFB output 
at time i. 

Since the a priori distribution of the input X'~ L: ' is not 
known in general, the estimate x ! in ( TToT ) could be chosen 
at the center of the box [x' (u ! )l which represents an eas- 
ily evaluated approximation of the centroid of the polytope 
2£ x (uM. Besides [x ! l = [x' (u')l may be used for the esti- 
mation of x ,+ 1 . 

When no satisfying solution can be found, at Step 6. or 
at Step 10., the estimate corresponding to the classical ML 
estimate of u ! is chosen, even if this may have a detrimen- 
tal impact on the next estimates. An error message is thus 
provided. 

6. EXPERIMENTAL RESULTS 

This section provides preliminary results obtained using the 
algorithm of Section [5] Two types of one-dimensional sig- 



nals are considered: a discrete-valued signal consisting of 
Lines 55 to 58 of Lena.pgm and a discrete-time correlated 
Gaussian signal with a correlation ratio of 0.9. For each sig- 
nal, 2000 samples have been considered. 

The resulting signals go through an OBF based on Haar 
filters, with M = 6 subbands and a downsampling rate N = 4. 
Rate allocation is performed to equalize the variance of the 
quantization noise in each subband. A BPSK modulation of 
the binarized indexes is performed before transmission over 
an AWGN channel with SNR from 6 dB to 1 1 dB. The re- 
sults have been averaged over 250 noise realizations for both 
signals. 
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Figure 2: SNR of reconstructed signals as a function of chan- 
nel SNR for Lines 55 to 58 of Lena.pgm 
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Figure 3: SNR of reconstructed signals as a function of chan- 
nel SNR for correlated Gaussian signal 

Figures|2]and[3]show the average reconstruction SNR as a 
function of the channel SNR. Three reconstruction methods 
are compared. The OFB input signal is reconstructed with 
the proposed estimator (with and without PCT) and with the 
conventional reconstruction method that uses the synthesis 
filter R(z) on the most likely vector of indexes, after its in- 
verse quantization, at each time instant, without paying any 
attention to the fact that it may not belong to a i/\ . The num- 
ber of candidates considered at each iteration has been set to 
AWx = 20. The reference reconstruction SNR corresponds 
to a signal corrupted only by quantization noise. 

For both signals and without the use of the PCT, a gain of 
about 8 dB in reconstruction SNR is observed for a channel 
SNR of 7 dB and a gain of about 2.5 dB in the channel SNR 



is observed for a signal SNR of 14 dB . The use of the PCT in 
the proposed algorithm improves the performance in terms of 
reconstructed signal SNR. For a channel SNR level of 7 dB, 
the gain in signal SNR is about 1 dB for the first signal and 
of 2 dB for the second one. 

For the Gaussian correlated signal, the correlation be- 
tween samples has not been explicitly taken into account 
here. It may be taken into account in ( TToT i to further improve 
estimation performance. 

7. CONCLUSION 

In this paper we presented an estimation method that exploits 
the redundancy introduced by OFB as well as the fact that the 
noise introduced by the quantization operation is bounded. 

The obtained experimental results have shown the im- 
provement brought by this approach when compared to a 
classical estimation technique. The use of a parity-check fil- 
ter bank allows to increase the performances of the method. 
This motivates us to propose methods that use the PCT in a 
more efficient way. Future work will be dedicated as well to 
extending the proposed approach to images and video. 
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